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Abstract 

In this paper we show that d-dimensional Gaussian spin glass models are strongly stochastically 
stable, fulfill the Ghirlanda-Guerra identities in distribution and the ultrametricity property. 
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1 Introduction 

After the important result by Panchenko 22 on the proof of ultrametricity for a class of mean field 
spin glasses the next natural question is to understand if its validity can also be established for a 
d-dimensional lattice model more closely related to physical systems. Among those the Edwards 
Anderson model defined by the Hamiltonian on A C Z'^ 

HA{cr) = - Jijaidj (1) 

has certainly played a major role [T3]. That model has escaped so far a rigorous mathematical 
analysis. From the physical point of view the open question is do and (if yes) to what extent finite 
dimensional spin glasses behave according to the mean field theory [18] . The question can be made 
more explicit in terms of the overlap (Hamiltonian covariance) probability distribution: 

1. the overlap distribution has a non trivial support. 

2. the multi-overlap distribution factorizes into the single one according to the Parisi's ultramet- 
ric scheme. 
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The present paper deals with question 2) and answers positively to it. 

Let us first illustrate the statistical physics ideas that we are following. The factorization laws 
that we deal with in this paper can be understood as consequences of a simple stability method. 
Stability in Statistical Mechanics works by identifying a small (yet non-trivial) deformation of 
the system, prove that in the large volume limit the perturbation vanishes and, by means of the 
linear response theory, compute the relations among observable quantities. This method leads to 
interesting consequences and applications because it reduces the a priori degrees of freedom of a 
theory. Following the ideas developed in [TT] one starts, in classical models, for smooth bounded 
functions / of spin configurations, from the counting measure 

^~(/) = ^E/('^)' (2) 

a 

and defines the equilibrium state 



By considering the Hamiltonian per particle 



hN{^) = ^ (4) 
the classical perturbed state is defined by 

Since the perturbation amounts to a small change in the temperature 

one has that, apart from isolated singularity points, in the thermodynamic limit 



dX 



0. (7) 



One may appreciate the content of the previous property by showing that it implies, for the Curie- 
Weiss ferromagnetic model in zero magnetic field, the relation 

ujp{aia2(T3a4) = ujp{aia2f . (8) 

Hence, although the magnetization itself may fail to concentrate due to a spin-flip symmetry break- 
ing, the square of the magnetization does concentrate in the thermodynamic limit. 

The previous approach leads to the concept of Stochastic Stability when applied, suitably 
adapted, to the spin glass phase. Consider, for smooth bounded function / of n spin configu- 
rations, the quenched equilibrium state 



< / >,,^^ E ( ) . (9) 
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Define the deformation as: 

JA) _ < /e-^'^" > 

We observe that the previous deformation is, unlike in the classical case, not a simple temperature 
shift. In fact: 



E 



/(<T)e-<'^ + ^/")-^iv 



c /■^(^) - "V E.e^^^^ nil 

nevertheless, the system is still stable with respect to it in a sense that will be made precise in the 
following sections and is essentially captured by saying that apart from isolated singularity points, 
in the thermodynamic limit 

^</>^'^^0. (12) 

Moreover the previous stability property implies (by use of the integration by parts techinque) that 
the following set of identities (Ghirlanda-Guerra), first derived in [15 , holds: 

< /Cl,n+1 >/3,Af= - < / >I3,N< C >/3,Ar + (13) 

n 

1 " 
" i=2 

where the term Ci^„+i is the overlap between a spin configuration of the set {1,2, and and 

external one that we enumerate as the (n + l)-st, and cij is the overlap between two generic spin 
configurations among the n's. 

The proof ideas can be easily summarized by the study of three quantities and their differences 
which encode the fluctuation properties of the spin glass system: 

E[u;{H%)] , (14) 

E[w{HNf] , (15) 

E[Lj{HN)f . (16) 

The result is obtained by two bounds for constants e^'' and e^'' vanishing in the N oo limit: 
• bound on averaged thermal fluctuations 

E [oj{Hfj) - lj{Hn)^] < e^^TV (17) 

obtained by stochastic Stochastic Stability method (see [2]) by showing that the addition 
of an independent term of order one to the Hamiltonian is equivalent to a small change in 
temperature of the entire system: 

l3HNi<7) PHNia) + ^H^{a) (18) 



+ ^ (19) 
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• bound on disorder fluctuations 

U = lu{Hn) (20) 

E([/2) -E(t/)2 < e^^AT, (21) 

which is the self averaging of internal energy and can be proved from self averaging of the free 
energy (with martingale methods or concentration of measures). 

In the following sections we show how to use the previous ideas to obtain a stronger result, namely 
the validity of the previous properties in distribution for quenched probability measure of the 
Hamiltonian covariance. 

The paper is organised as follows: Section 2 introduces the basic definitions to construct the 
class of models which satisfies thermodynamic stability. Section 3 shows the identities which can be 
derived from such properties. Section 4 deals with the rate of convergence in the thermodynamic 
limit. Last section contains the discussion on the connection between those identities and the 
Parisi's ultrametric property. 



2 Definitions and preliminary properties 

The model we chose to work with is the most general spin glass in d-dimension and at the same 
time the closest to physical reality. Physical particles in fact, beside interacting in pairs have always 
higher order interactions, i.e. they interact in triples, quadruples etc. (see |25|). Given a lattice in 
dimension d, for example Z"* we consider, for each finite set A C Z"*, an Hamiltonian of the form 

HAicy) = -J2 "^A.x^Tjf , (22) 

XCA 

where ax = Yixex '^^ ^^'^ where all the random couplings Ja,x are independent centered Gaussian 
random variables with E[J^ j^] — Aj^ for some nonnegative constants {Aa,x)xca- 

The thermodynamical properties of the previous models are encoded within the quenched dis- 
tribution of its normalized covariance 

CA('T,r) = ±E[HAia)HA{T)] = ^ E ^Ix^^^x . (23) 

The condition for existence of the thermodynamic limit (in the sense of Fisher) called "thermo- 
dynamic stability" is: 

m E ^1^ < c < oo , (24) 

see [iniin]. 

In order to introduce the necessary language to illustrate our results we start by the following: 

Lemma 2.1 Let ca and c'^ be two normalised covariances of Gaussian spin glasses satisfying the 
condition of thermodynamic stability. Then the same condition is satisfied by the normalised co- 
variance obtained through the operations below: 

• CA + c'j^, entry-wise addition 
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• x^ca for each x G M, scalar multiplication 

• c\c'f^, entry-wise multiplication. 

Proof: We first observe that the three considered operations define new covariances, in par- 
ticular the last covariance is sometimes called the Schur product, Hadamard product or Schur- 
Hadamard product and is semidefinite positive by a lemma of Schur. 

The conditions of thermodynamic stability for ca and are 

supca(it, a) < oo and supc^(cr, ct) < oo , 
A A 

and immediately imply that 

sup [cA (cr, cr) + c^(cr, cr)] < oo , 
A 

sup a;^CA(o', (t) < oo and 
A 

sxq)c\{a,a)c'jy{a,a) < oo . 
A 

The explicit inversion formula from the covariance to the Hamiltonian can be seen from Chapter 2 

of [ig. □ 

The previous lemma says that the set of the thermodynamically stable covariances is closed 
under the three operations defined. 

By the previous lemma, starting from the Hamiltonian we can always construct a thermo- 
dynamically stable Hamiltonian, that we call complete Hamiltonian, defined by 

^A(a;/3) := ^(V^)-^ (25) 
p>i 

where H'^\a) = H\{a) is the Hamiltonian and each p-term in the sum has a normalized 
covariance 

ci^)(a,r) = [cA(a,r)f 

and the family of parameters j3 = (/3p)p>i is such that /3p > for every p and fulfills the condition 

p>i 

A simple computation shows that the complete Hamiltonian has a covariance 

CA(a,r)=^(c)-^/32[cA(a,r)f 

and is thermodynamically stable with constant c. 

Consider n copies of the configuration space denoted by cr^,...,cr" and, for every bounded 
function / : (cr^, . . . , cr") — > R, we call the random n-Gibbs state the following r.v. 

^KAf)-^ E /(^\---,^")eA,M'^')---^A,/3K) (26) 
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where 

yA,p{(^) ■= 7 — ^—7 — ^ i^'j 

2^^exp(-i?A(cr;^)) 

is the random Gibbs measure. In the previous formula the dependence on the physical /3 is reab- 
sorbed in the family of /3p's. 

We can define the quenched Gibbs state as 

(/)a,^ :=Er!A,/j(/) (28) 



3 Identities 

Theorem 3.1 The model defined by equation I125\) satisfies with respect to the covariance I123\) the 
following properties: 

(i) It is stochastically stable in the strong sense, i.e for every power p G N and for almost every 
I3p, the following hold 

n n 

/^,fe-2"/E<n+i+-("+l)K+i,„+2)^_^ = 0, (29) 

where for any number of replicas denote by Cj^k ths quantity c\{a^^\ a^'''^) , and 

where we assume that f is a continuous function of all the variables Cj^k for 1 < j < k < n. 

(a) It fulfills the Ghirlanda- Guerra identities (GG for short) in distribution, i.e. the following 
identities are verified for every n > 2 and every function f of (cj.k)" k=i above, and every power 
p g N and for almost every (3p . 



lim 



1 1 1 

(K+1^„+2)a,/J - ^{f(?k,n+l)KP - (/)a,/3(<2)a,/3J = ' (30) 

k=l 

Moreover, let 

P^^^ '-^ A"^. ^E[logEexp(-^A(a,/3))] 
be the thermodynamical limit of the pressure. 

If p{f3) is differ entiable in the l3p "direction" at the point /3p — a then 

(Hi) It is pointwise stochastically stable in the strong sense, i.e for every power p G N and in 
each point Pp — a, i29) hold. 

(iv) It fulfills the Ghirlanda- Guerra identities in distribution pointwise, i.e for every n >2 and 
for every power p £ N and in each point f3p = a, I130\} holds. 

Remark 3.2 we notice that since the function p{p) is convex in each j3p then it's almost everywhere 
differ entiable and then we have that (iv) => (ii), but in the next sections we give an independent 
proof of (ii). 
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Proof of Theorem 13.11 We fix an arbitrary p > 1 and to ligliten tlie notation we put: 



I3p ^ X 

Tlien the Hamiltonian defined in (pS)) becomes 

To prove the theorem we recall a general result due to Panchenko 21 . Consider a general Hamil- 
tonian of the type 

where x is a real parameter and the families {H{a))a and {H'{c7))a are independent jointly Gaussian 
families of centered r.v.s. of the type (|22|) . Suppose that the Hamiltonian are thermodynamically 
stable in the sense of (p4|) . that is there exists a global constant c such that 



(31) 



Ei?A(cr)^ < |A|c 
Ei?;(CT)^ < |A|c 

Consider, the following basic quantities: 

Za{x) := ^ exp(-iyA(a'; x)) 

(7 

Pa{x) := |^logZA(a;) 
p(x) := lim Epjy(x) 

Notice that existence of the limit in the last definition is ensured (see for example [12]) by the 
conditions (|3T1) . We define ftA.x{ ) and ( )a,x in the same way as in p6p and ([28l) . 

In the previous setting we have the following lemma: 
Lemma 3.3 If we denote h'j^(a) := j^H'j^{a) the Hamiltonian density, then we have that for every 

Pi < 1^2 



(32) 



lim 



lim 



/i^(a)-l]A,a(/i'(^))|)^^rfa = 



h'Aicr) - {h'A{a))AM 



da^O 



On other hand, if we assume that p{x) is differ entiahle at x — a, then 

h'A{a)-nA,a(h\a))\^ ^^=Q 



lim 



(33) 
(34) 

(35) 
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lim 



= 



(36) 



It is easy to check by a simple integration-by-parts and a uniform norm bound that the rela- 
tions ((33)) . (pi]) . (1351) . (p6| implies the propositions i) , ii) , in) , iv) of Theorem l3.11 respectively. We 
notice that the propositions i),n) are in almost every sense then in this case the proof of previous 
implication requires some elementary facts in measure theory which are explained in Remark 14.41 

Proof of Lemma 13.31 The strategy of the proof is to control all terms by the following 
estimation, which is essentially contained in Chapter 12 of [28]. 

Proposition 3.4 For every b > we have that 



2EL>A(a,6) 



6|A| 



8EDA{a,b) 



n 



A,a(/l'(fT)) - {h'^{a))A,a\)^^<KDA{a,b)+EWAia,b) 



(37) 
(38) 



where 



Da{x, b) := p'f,{x + b)- p'^ix - b) 

WA{x,b):=^ {\pa{x + 5) - EpA(a; + h)\ + \pa{x - b) - EpA(a; ~b)\ + \pa{x) ~ Epa{x)\ 

Proof of Proposition [374t equation ()38p : the function pa{x) is convex. Thus for every 6 > 
we have that 



< WA{x,b)+WA{x + b): 



and then 

p'j^{x) - Ep'j^ix) < Wa{x, b) + Wa{x + Wa^^) < Wa{x, b) + EL>A(a;, b) . 
On other hand, 



PAi^) > 



Pa{x - b) +pa{x) 



and then, after the same manipulations, we get 

Pa (a;) - Ep^(x) > -Wa{x, b) - EDa{x, b) 
Combining the two previous inequalities we obtain the following bound 

\p'a{x)-Wa{x)\ <WA{x,b)+EDA{x,b) 
This bound give immediately (1551) . since 



(39) 



nA,a(h'{a)) - {h'j^{a))A,a\) ^^^^{\p'A{a) -WA{a)\) < EW^A(a, 6) + EZ?A(a, 6) . □ 



The bound (1371) requires an extra work. 
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Proposition 3.5 Consider the quantity 



th 



en we nave 



that 



Proof of Proposition I3.5t During this proof we define for sake of simplicity the quantity 

Vi :=/i^(a('))-r!A,.(/i^(a)) 

then we have that, for every I, m 

p'i{x)^\A\nA,,{v,') 

By Jensen's inequahty and the previous equations we can obtain the first bound of the propo- 
sition, indeed 

The second bound follow easily by Cauchy-Schwarz inequality, indeed 



< 



|A|r2A,x 



< 2 



|A|r!A,x( 



VI-V3+V2--V3 

The last proposition can be used to obtain 
Proposition 3.6 Given b > then 



V1-V2 



V1-V3 



< 2 



\M^A,.[{vi-V2y) <8plix)n 



E|^A(x)|<^^^^j^ + 8Ei?A(a,6) 
Proof of Proposition 13. 6t We observe that for a; — 6 < y < x + 6 we have 

x+b 



IV'A(x)-VA(y)| / IV-aWM^ 



and then 



x+b 
x — b 



<2b I ^ WAt)\dt 

X — b 



The identity 



implies that 



/x+b rx+b 



x+b 
b 



2b 



x+b ^ px+b 

^Aiy)dy + — / [i^Aix) - ipAiyUdy 

-b ^0 Jx-b ^ ' 



and then Proposition 13.51 imphes that 



\^a{x)\ < ^ yfi[(jj)dy + 8 [^\'i{y)dy 



b\A\^ Jx-b 

We can use the Jensen inequahty in the first term of the r.h.s of the previous relation to get 

I^A(^)I < ^( l"%liy)dy)^+s £\liy)dy 

To conclude, we take the expectation and using again the Jensen inequality and the obvious 
relation 



PA{y)dy = PAix + b)- p'f^{x - b) 



and the proof is complete. □ 



Proof of Proposition [374l equation ([37]): To obtain (|37)) we simply observe that by Jensen 
inequality 



h'i^{o)-^A^a(h'{a))\^ ^^<mjA{a)\ 
and then by Proposition 13.61 we get the desired result. □ 



Now we are able to prove Lemma [ 
Proof of Lemma 13.31 We start to prove the equations (l33l) and ((35)) which give the stochastic 
stability. 



First, using the convexity of the function pa{x) we can prove easily that 

DA{a.b) < ^(j)A{a + 2b)-pA{a + b)+pA{a-2b) -pA{a-b)'^ 



(40) 



It is easy to check that EpA(a;) is bounded for every x, A and then for every a, b, A we have that 

EDA(a,b) < ^ < oo. 



. Then from (1371) . using Fubini's Theorem, we get the following bound: for every 6, /3i < (32 

DA{a, b)da 



|A| 



-81 



10 



and then 



da < 



- fii) 25 
b V |A| 



+8E(pA(/32+&)-PA(/3i+fo)-PA(/32-6)+PA(/3i-&)^ 



Finally, we can use the limt,_i.o limswp^yi^d and the continuity of the function p{x) to get (|33|). 

To prove (I35p . we use the hypothesis of differentiabihty of the function p{x) at the point x = a 
to get from pO)) the following 

linilimsupEi:)A(a,&) < lim -(p(a + 2b) - p(a + b) + p{a - 2b) - p(a - b)) = (41) 



and then we can bypass the intermediate integration to obtain from (|37p the following bound: for 

every a, b 

(\h'^ia) - nA,a{h'{a))\)^ ^ < 8Ei?A(a,fo) 
Finally, we can use the limb^o limsupA/ix'' ^-^d relation (jH)) to get ([55]) . 

Now, we are able to prove the equations (IMl) and ([55]) which give the GG-identities. 

We already obtained the control of the quantity Z?, moreover a simple inspection shows that 
the quantity WA{a, b) is strictly related to the self- averaging of pa{x)- Then it's easy to check (see 
for example |10j ) that the thermodynamic stability condition ()3ip ensures that there exists a finite 
quantity if (a, b, c) which does not depend on A, such that: 



lWA{a,b) < K{a,b,c) 



b\A\i 



(42) 



From ([551) and (|^ . we can obtain as before the following bound: for every 6, /3i < /32 



f^A,a(/l'('T))-(/i:vM>A,a|)^^da<E(pA(/32+6)-pA(/3i+6)~PA(/?2-6)+pA(/?i-6)) + 



K{0i,l32,b,c) 
5|A|5 



where we have set K{(3i, /32, b, c) :— J^^ K{a, b, c)da to lighten the notation. 

Finally, we can use the limb^.o limsupA/izt* the continuity of the function p{x) to get (1341) . 

Like in the previous case, the hypothesis of differentiability allow us to bypass the intermediate 
integration and then, from ((38)) . we have that, for every a, b 

( nA,a(h'{a)) -{h'^{a))A.a ) <EDAia,b)+K{a,b,c)-^ 

\ V / /Am b\A\2 



Finally, we can use the limb^o limsupA/iz'' relation (|4T|) to get (|34|).D 
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4 Rate of convergence 

We outline in this section a sharper version of a theorem that appears in ^28j and prove it with 
more elementary methods for the benefit of the reader, following the approach developed in pilTU]. 
As in Section 3, we consider 

HA{a; x) = H^ia) + xH'j^{a) , 
where H\ and H'^ are independent, and defined as in (2). The main theorem in this section follows: 



Theorem 4.1 (a) Writing h'^ = |A| "^H'p^, as befo 



dx < 



2(ki| + |a:2|)c:, 
|A| 



(43) 



where c'^{a,cr') is defined to be |A| ^\E[H'j^{a)H'j^(a')]\, and 
(b) For any Xi < Xi 

1 



dcf 



sa' |c;^(cr,cr')|. 



X2 — Xi 



< 4 |xi| + \X2\ 



(cX|A|)i/4; V^J^|A|i/4 



(44) 



4.1 Application: Distributional Stochastic Stability via Perturbations 

The quantitative version of the Ghirlanda-Guerra identities follows from this. 

Corollary 4.2 Suppose ca(<7, u) = for every a. Then for every non-random function of n 
replicas, i-^"^ (cr^^) , . . . , cr^") ) , with maximum norm at most 1, we have the conditional expectation 
formula for one additional replica 

^2 / r' (rrW rrC^+l)"! \ 



ca 



K,x 



1 



•^2 -^1 J XI 

for every pair < xi < X2, where 

7i"ka«,...,a(")) = i 
and the remainder satisfies the bound 
n |Rem| < 



7i"^(a(i) , . . . , a("))$(") (a(i), . . . , a^")) ) d{x') + Rem 

A, a; 



E 

.k=2 



c^(aW,aW) , /4(a,a') 



-c'a 



-c'a 



A,x 



23/2 



X 



1+X2 y/a 



where Sa is a small parameter 6\ — 1/(|A|ca). 



el/2 



y/X2 - X\ 



.1/4 
"A ' 



(45) 
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Proof: Let us define 



Rem 



1 



X2 — Xi 



Any 



dx . 



By the triangle inequality and Cauchy-Schwarz, and the fact that ||$)\^ |loo — 1' know that 
I Rem I is bounded by 

\ 1/2 



1 



a;2 — xi 



plus 



1 



f^A,x (^a) - (^A>A.x 



dx 



dx . 



X2~ Xi 

Using equations (|43l) and (|44|) . this bound is at most c^(xi + a;2)/2 times the right hand side of 
p5)) . In other words, we have an upper bound on Rem which is at most c'f^{xi + X2)/(2n) times 
the bound we claimed for Rem. 

But Gaussian integration by parts implies that 



A, an 



fc=i 



na:(4(aW,a("+i)).<i>i")(aW,...,a(")))^ 



See for example Lemma 14.51 for a similar calculation carried out in more detail. A special case of 
this formula, obtained by setting ^'^"^ = 1, also gives 

-{l^'f^Kx = a;[(cA(o-,cr))A,x - (cA(cr,cr'))A,a;] • 

If we combine these two formulas, this allows one to rewrite Rem. If we assume that c^(ct, cr) is 
constant as a function of a, meaning there is a constant diagonal covariance, then the k — 1 term 
of the first formula cancels with the (cr, a) in the second formula. Therefore, we get 



Rem = 



n{x2 - xi) J^^ 



in), 



) xdx. 



Note that the measure cc dec is ■^■d{x'^), writing the Riemann-Stieltjes differential form (i(x^) = 2xdx. 
Since 

/ d(x^) = xl- xl = {X2 - xi){xi + X2) , 
J xi 

we also divide by an appropriate normalization ■^{xi + X2) times c^/ri to get the bound for Rem 
from the bound on Rem, which gives the result. □ 



As an application of this result, consider the following scenario. Suppose that for each A, there 
is a given Hamiltonian iJj^ with covariance 

nHl{a)Hl{a')] = |A|4(a,a'), 
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where we assume that c^((t, ct) — c\ for aU a, and we assume that c* — sup^ c\ is finite, in order 
to satisfy thermodynamic stabihty. 

By Lemma [2. II we know that we may construct IID Gaussian centered Hamiltonians Hj^\a), 
for p = 1,2,..., which are independent of and such 

E[H^^\a)H^^\a')] = |A| [^(a, a'^ . 
For each 6 > and a real sequence x = (xi, X2, . . . ) we define the perturbed Hamiltonian 

oo 

p—i 

We denote by (• • ■)a.x the quenched muhi-rephca equihbrium measure with respect to Hj^{a;x). 
Then we may prove the following corollary. 

Corollary 4.3 Suppose that the sequence {e\) satisfies lim|A|->oo IM^'a — ^ (^i: • • ■ ) 

be an IID sequence of random variables, each uniformly distributed on [0, 1], all of which are inde- 
pendent of Hf^ and h'"^^ for p — 1,2,... and all A. Then for almost every choice of X we have 
stochastic stability in distribution: for each n,p G {1, 2, . . .}, 



hm max' ( ( ^(a^i) , a("+i))]^ - - j^Kia^'^ '^^"^ W - - iKia, a'W) a,..x] * 



(")\ =0, 



where max^(„) is the maximum over all non-random functions <1>^"-' {cr^^\ ■ ■ ■ , cr^")) satisfying H^^"^!] < 
1. 

Proof: In order to prove this, for a given p, we merely split up the Hamiltonian: 

IlA{a;ex) = HA[cr) + XpH'f^(a) HA{a-;Xp), 

where 

oo 

HA{a)=HX{a)+eJ2^^Hi'\a), 



and 

W. (^\ - 

p[c*]P/' 



With this definition, we have c^((t, cr') = [c^lc, 0"')]^ but the constant prefactor has been explicitly 
taken into consideration in Corollary 14. 21 by normalizing by c^. It does enter into the definition of 
the remainder in (|45p through the small parameter which is 



That is why we required |A|e^ — >■ oo, because this guarantees 5a — 0, as is needed. □ 
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Remark 4.4 Note that technically what we proved is that for any open interval for Xp in [0, 1], if 
we average the distributional stochastic stability equation over that interval, when integrated against 
the measure x dx, then we obtain zero in the limit. On the other hand, the quantity in question is 

and this is bounded for every x by 2[c^]''. Then by standard arguments from measure theory, we 
may conclude that for almost every choice of x with respect to the measure d^{x) = 2x dx = d(x'^), 
the quantity is also zero. But this measure is equivalent to Lebesgue measure in the sense that they 
are mutually absolutely continuous with respect to each other. So the notions of measure zero sets 
are the same. 

This means that letting Xp be random, then for almost every Xp we have the stochastic stability 
formula for the pth power of the overlap. But, firstly, we note that we may rigorously take an 
infinite number of IID uniform random variables X = {Xi, X2, . . . ) by Kolmogorov's principle, and 
secondly that the measure is precisely the product measure for all the Xp^s. Therefore, knowing 
that for each Xp we have the stochastic stability condition for almost every Xp, by definition, this 
means we have the stochastic stability condition for all p for almost every X. 

4.2 Proof of Theorem 

In the proof of Theorem 14 . 1 1 we will condition on H\{a) in order to eliminate the need to consider it 
as random. But we will do this implicitly. If desired, simply interpret all expectations as conditional 
expectations, conditioning on i?A(c). 

The proof will be obtained by combining several lemmas. First, we note that by usual calcula- 
tions as in elementary statistical mechanics, 

-^Pa(x) - -n^^^ih'^), (46) 
dx 

as has been used already in Section 3. Moreover, by performing Gaussian integration by parts, we 
may deduce this; 

Lemma 4.5 For any x 

^nPAi^)] = -K)a.. = f {c'^{a,a)+c'^ia',a')-2c'^ia,a'))^^^ . (47) 
Proof: Since A is finite, the derivative exists and we may write 

^E[pa(x)] = E[r!A,.(/iA)] 
by using (|46| . Recall the definition of 57a, 2; as well as Ga,x from equations ([26l) . ([27|) and (f28| . Then 
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Wick's rule gives 



exp {-Ha{(7;x)) 



id/dH'j,{a))expi-HA{cT;x)) 



Za{x) 

exp{-HA{a;x)) d , ' 



Since Ha{(t;x) — Ha{(j) + xH'^{a), this means {d/dH'^{(7))exp{—H\{(7;x)) = —x exp{HA{a)). 
Using this and the lact that E[h'^{a)H'f^{(7')] ^ \h\-^E\n'tJyG)H'^((T')\ = c^(ct,ct'), this gives the 
result. □ 



Corollary 4.6 For any x 



dof 



Proof: This follows from (j47| and a uniform bound using the definition := max^o-' |ca((T, ct') 
□ 



With this, we can prove the first part of the theorem. 

Proof of Theorem 14.11 part (a): Another statistical mechanics calculation following (|46)) is 



dx"^ 



So, integrating and taking expectations, we have 



E 



/ia(o-) - '^A,x{JIa{'^) 



Recall that (• • • ) a.x = E[fJA,x(- • • )]• But by (gll) and Corollary l46l this leads directly to gS]). □ 

In order to obtain the proof of Theorem 14. 11 part (b), we will use concentration of measure. Our 
main goal will be to obtain a bound on the random fluctuations of the quantity ^a.x [h'^) ~ {h'A)A.x- 
We start by quoting a result which was proved in [TBj : 



Vt > 0. 



P \pa{x)-E[pa{x)]\ > 



t < 2e"*'/2 , a.s.. 



where recall that c'a was defined in the statement of Theorem 14.11 P^rt (b) . 

We now claim that the following result may be proved using this and previous results: 



Lemma 4.7 For any x, and for any e > 0, we have 



E 



^Kx {h'A) ~ {h'A) 



A.x 



< 



4(|x|+6)v/24 



e I ^(l-|z|)E 



d'^PA 
dx"^ 



[x + ez) 



dz . 



(48) 



(49) 
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Proof: By pS)) and Taylor's theorem 

Pa{x + e) - pa{x - e) 1 f dpA 



Pa{x + e) -pa{x - e) 



2e 



1 lR_(y)l(j,,o)(^^) - lR+(2/)l(o,y)(2) d^PA 



(2; + ez) dz I 



2^ +2 9iz)^ix + ez)dz, 



where we intechanged the order of integration and 



z - 1 for < z < 1 , 
1 + z for -1 < z < 0. 



For each z G [—1, 1], let us define the random variable 

(PpA 



Z,(z) 

which is nonnegative. Let us also define 



dx'^ 



{x + ez) , 



g{z)Z^{z) dz . 



Then we obtain 



!^A,x(/^A)-IE[f^A,.(/lA)] = 



{pa{x + e) - E[pa{x + e)]) - {pa{x - e) - E[pa{x - e)] 

2e 



We may use equation (gH) and the general subset bound, F{A U B) < F{A) + F{B), to obtain this: 
^A^x (/ia) - H^aAK)] < ''1^1 +^)V^ t + Y,- E[Y,] with probability p > 1 - 46"*'/^. 



(50) 



We have a similar statement for the lower bound. Therefore, again by the subset bound, 

\x\+e)y^ 



^A,x (/Ia) - (/Ia)a,: 



> 



■t+\Y,-E[Y,]\ < 8e-' 



Recall that (/i^)a,x = IE[i^A,a;(/iA)] by definition. 

So, using the fact that for any integrable random variable X , E[X] < P{X > t) dt, we obtain 



E 



^A,x{h'A)-{h'A)A,x <Km~E[YS + 



8{\x\+e)^c'^ 



z-'-'^dt. 



(51) 
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But now note that 



which imphes that 



(z) -E[Z,(z)]) dz, 



n\Ye-nyM < ^ jj9(z)\e[\z,{z)-e[z,{z)]\] dz. 

But smce Z^{z) is nonnegative, almost surely, this means that 

E[|Z,(z)-E[Z,(z)]|] < E[|Z,(z)|] + |E[Z,(z)]| = 2E[Z,(z) 
Combining this bound with ([5T|) gives the desired inequality (021) • 



□ 



With this, we can prove the remainder of the theorem. 

Proof of Theorem 14.11 part (b): For any xi < X2, integrating (H^ and dividing by the 
length of the interval we obtain 



1 



^2 Xl J j.^ 



E 



dx < 



2{\xi\ + \x2\+2e)^/2^ 







f{i-\A) 


(/>[ 







dx^ 



(x + ez) 



(52) 



dx ] dz . 



But, by the fundamental theorem of calculus, (HTl) and Corollary 



dx^ 



■{x + ez) 



dx = E 



dp A, , 
— (a; + ez) 
dx 



so that 
e 



dx"^ 



{x + ez) 



da: 1 < / (l-|z|)(|a:i| + |a;2|+2e)dz. 

X2 - Xi J_i 



Using this with (|52l) gives the result 
1 



X2 - Xi 



E 



dx < 2{\xi\ + \x2\ +2e) 



cj^e 



E^7r|A| X2-X1 



(53) 



Now we may optimize in e > 0. We choose e — ^X2 — xi/(c^|A|)^/'' to get the desired result, 
equation dH]). □ 



5 Conclusions and perspectives 

A major new development in the subject of mean-field spin glasses is Panchenko's proof that strong 
stability implies ultrametricity. More precisely, Panchenko in |22j proved that if a random proba- 
bility measure G in a Hilbert-space-valued inner-product satisfies the Ghirlanda-Guerra identities 
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in the distributional sense, then this imphes uhrametricity. Let show how to combine the resuhs 
of the previous sections with the Panchenko's theorem. 

A random measure G satisfies the Ghirlanda-Guerra identities in the distributional sense if 
for any n > 2, any bounded measurable function / of the overlaps {ci^i')iji<n and any bounded 
measurable function ip of one overlap, the following hold: 

1 1 " 

Er!(/V;(ci,2)) = -Er!(/)Er!(vXci,2)) +-5lEf^(/^(ci,0) (54) 

1=2 

where ft is the average with respect to G®°°. 

A random measure G is said to be ultrametric if the distribution of {ci_i')i^ii>i satisfies 

E17(/(ci^2 >min(ci,3,C2^3))) = 1 (55) 

By Theorem I3.1[ we can deduce that the asymptotic Gibbs measure of the model defined in (|25l) 
satisfies the condition ([54)) for every power of the covariance and, by the Stone- Weierstrass theorem, 
this suffices to ensure that the Ghirlanda-Guerra identities hold in the distributional sense. More 
precisely Theorem 13.11 has two consequences. The proposition {iv) implies that 

lim_^Ef7A,^(/V(ci,2)) = -E17A,/3(/)Er!A,^(V'(ci,2)) +-^Er!A,,3(/V'(ci,0) (56) 

The proposition (ii) implies that this equation is true for almost every choice of parameter (3 = 
(/3p)^i- In both case, we can identify the asymptotic Gibbs measure with a random probability 
measure in a Hilbert-space using the representation theorem of Dovbysh and Sudakov (see [3] or 
|23j ) and the measure is ultrametric by the Panchenko's result. 

But it had been earlier known that the Ghirlanda-Guerra identities, when combined with ul- 
trametricity, imply that the precise distribution of the overlaps is given by the general class of 
Derrida-Ruelle Poisson-Dirichlet random probability cascades. This result is know as Baffioni- 
Rosati theorem (see ^ and [25 for a more complete exposition). One of its consequence is that for 
an uncorrelated model (defined by having all the overlaps either go < 1 or 1) the Ghirlanda-Guerra 
identities imply that it behaves as a single level Derrida-Ruelle cascade known as the Poisson- 
Dirichlet random partition function. See for example [26] . Therefore, to summarize, Panchenko 
and Baffioni-Rosati results and Theorem 13. 11 implies that a general Hamiltonian (|22|) has an ultra- 
metric Derrida Ruelle quenched equilibrium measure. 

We have proved that all triangles of c-overlaps in a wide class of d-dimensional spin glass models 
must be isosceles or equilateral, as demanded by ultrametricity. This doesn't exclude the possibility 
of having only equilateral triangles, which is the trivial case for the overlap. We hope to return to 
study this question in the future. At present the issue on triviality is only studied numerically (see 
[29l 15 for a recent debate) . 

It has been observed that for models such as the Edwards- Anderson model, the genuine over- 
lap q and the link overlap Qunk = ca, are equivalent in the sense that the conditional quenched 
distribution of one given the other is actually non-random |13j . This has been numerically veri- 
fied up to the computational limits in the citation and contradicts the interpretation of previous 
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work [5ni dZ] . The results presented in this paper suggest the possibility to approach the replica 
equivalence conjecture by observing that not only are both q and Qi ultrametric, but actually so 
is any choice of a c matrix in the closed positive-cone algebra. This led to the idea of considering 
(1 — t)q + tQ\ and its properties for every t £ [0, 1]. 

We finally mention that the ideas outlined within this work can be viewed as classical probability 
problem of the type called infinite divisibility. One may consider a general type of transformation: 
let 

7a (• ■ ■)a = {■)a.x ■ 

Then stochastic stability refers to stability under 7^^'^' in the limit |A| — >■ oo: which we may refer to 
as even though one must interpret this in terms of limits. This is invariance of the expectation, 
since (• • • )a is defined to be E[r2A(-)]. But if one allows for a more general transformation, which 
shifts by higher-order interactions, then one can also conclude stochastic stability in distribution, 
not merely in expectation. 

A fundamental concept in probability is invariance under random transformations. Stochastic 
stability should be viewed in that context. Infinite divisibility refers to the property of being in the 
range of a transformation such as for all x. The quenched state for spin glasses satisfies invari- 
ance, which is stochastic stability. But a more general question is to search for those distributions 
which satisfy infinite divisibility. This could be a line of further investigation, elsewhere. 

In our paper we have tried to demonstrate the following point, which we feel bears repeating. 
Panchenko has showed that stochastic stability implies the ultrametric replica symmetry breaking 
scenario [22] (which does also include the possibility of trivial ultrametricity, where for any three 
replicas, the triangle formed by the intrinsic overlaps may be equilateral always). 

Panchenko's proof uses a strong version of de Finetti's theorem. But this applies because 
of permutation invariance of the replicas, not the underlying model. Indeed as we have shown, 
stochastic stability and its implications even apply to the Edwards- Anderson model if it is perturbed 
by an arbitrarily small inclusion of higher order interactions. Stochastic stability is a general tool, 
which in principle may be applicable to any disordered model in statistical mechanics including 
short-ranged spin glasses. We mention that using the language of metastates [3 stochastic 
stability has been approached in [4] where identities where proved everywhere in the parameters 
using periodic boundary conditions and averaging over translations. It remains open to show that 
their analogue of the link overlap coincides with the usual one which is what we used here. See also 
[7] for an alternative derivation of the stochastic stability identities. 

It is finally worth to stress that the addition of the higher orders interactions introduced in 
(|25|) is done in order to obtain the identities in distribution and not only in mean. The nature of 
those higher orders terms appear to be formally similar to the p-spin interactions of the mean field 
case models. In particular their interaction structure doesn't decay with distance but it's a sum 
normalised with the volume. At the same time we notice that the core term is still a two point 
interaction made of nearest neighbouring sites and as such it retains the topological information of 
the lattice dimension. While, as we properly explained, we make no claim on the non-triviality issue 
of the models, we observe that the deformation method allows us to reach not only the identities 
in distribution for the deformed model, but also to extend them to the original model by sending 
the deformation parameter e — as specified by Corollary (j4.3p . 

Acknowledgments The authors thanks an anonymous referee for a question who led to the 
final remark of the conclusion. SS was supported by an NSA Young Investigator's grant. 



20 



References 



[1] Michael Aizenman and Louis-Pierre Arguin. On the structure of quasi-stationary competing 
particle systems. Ann. Probab. 37, no. 3, 1080-1113, (2009). 

[2] Michael Aizenman and Pierluigi Contucci. On the Stability of the Quenched state in Mean 
Field Spin Glass Models. Journal of Statistical Physics 92, no. 5/6, 765-783, (1998). 

[3] Louis-Picrrc Arguin, Sourav Chatterjee. Random Overlap Structures: Properties and Appli- 
cations to Spin Glasses. Probab. Theory Relat. Fields DOI 10.1007/s00440-012-0431-6 

[4] Louis-Picrrc Arguin, Michael Damron. Short-range spin glasses and Random Overlap Struc- 
tures. ,/. Statist. Phys. 143, no. 2, 226-250 (2011). 

[5] Michael Aizenman and Jan Wehr Rounding effects of quenched randomness on first-order 
phase transitions Comm. Math. Phys. Volume 130, Number 3 (1990), 489-528. 

[6] Baffioni F., Rosati F. On the Ultrametric Overlap Distribution for Mean Field Spin Glass 
Models (I). The European Physical Journal B 17, 439-447, (2000). 

[7] Barra A., Irreducible Free Energy Expansion and Overlaps Locking in Mean Field Spin Glasses. 
J. Statist. Phys. 123, no. 3, 601-614, (2006). 

[8] A. Billoire, L.A. Fernandez, A. Maiorano, E. Marinari, V. Martin-Mayor, G. Parisi, 
F. Ricci-Tersenghi, J.J. Ruiz-Lorenzo, D. YUanes Comment on "Evidence of Non- 
Mean-Field-Like Low- Temperature Behavior in the Edwards- Anderson Spin-Glass Model". 
http://arxiv.org/abs/1211.0843 

[9] Anton Bovier. Statistical Mechanics of Disordered Systems: A Mathematical Perspective. Cam- 
bridge University Press, Cambridge, UK, 2006. 

[10] Pierluigi Contucci and Cristian Giardina. The Ghirlanda-Guerra identities. J. Statist. Phys. 
126, no. 4, 917-931, (2007). 

[11] Pierluigi Contucci, Cristian Giardina and Claudio Giberti. Stability of the Spin Glass Phase 
under Perturbations. Europhysics Letters 96, no. 1, 17003-17006, (2011). 

[12] Pierluigi Contucci and Cristian Giardina. Perspectives on Spin Glasses. Cambridge University 
Press, Cambridge, UK, 2012 December. 

[13] P.Contucci, C. Giardina, C. Giberti, C. Vernia Overlap Equivalence in the Edwards-Anderson 
Model. Physical Review Letters, 96, 217204 (2006). 

[14] S.F.Edwards, P.W.Anderson, Theory of Spin Glasses. J.Phys.F. Vol. 5, May (1975) 

[15] S. Ghirlanda, F. Guerra. General properties of overlap probability distributions in disordered 
spin systems. Towards Parisi ultrametricity. J. Phys. A: Math. Gen. 31, 9149-9155 (1998). 

[16] Cristian Giardina and Shannon Starr. Variational bounds for the Generalized Random Energy 
Model. J. Statist. Phys. 127, no. 1, 1-20, (2007). 



21 



F. Krzakala and O. C. Martin, Spin and Link Overlaps in Three-Dimensional Spin Glasses. 
Phys. Rev. Lett. 85, 3013 (2000). 

M.Mezard, G.Parisi, M.A. Virasoro. Spin Glass Theory and Beyond. Word Scientific, Singa- 
pore, 1987 

Newman C.M., Stein D.L., The Metastate Approach to Thermodynamic Chaos, Phys. Rev. 
E 55 (1997) pp. 5194-5211. 

M.Palassini, A.P.Young, Nature of the Spin Glass State. Phys, Rev. Lett. 85, 3017, (2000). 

Dmitry Panchenko The Ghirlanda-Guerra identities for the mixed p-spin model. Comptes 
Rendus Acad. Sci. 348, no. 34, 189192, (2010). 

Dmitry Panchenko The Parisi ultrametricity conjecture. Annals of Mathematics 177, Issue 1, 
383393, (2013). 

Dmitry Panchenko The Sherrington-Kirkpatrick model: an overview, em J. Statist. Phys. 149, 
no. 2, pp 362-383, (2012). 

Giorgio Parisi and Michel Talagrand. On the distribution of the overlaps at given disorder. 

Comptes Rendus Math. 339, no. 4, 303-306, (2004). 

David Ruelle. Statistical Mechanics, Rigorous Results. W.A. Benjamin, New York, 1969. 

Michel Talagrand. Spin glasses: A challenge for mathematicians. Springer, Berlin (2003). 

Michel Talagrand. Mean Field Models for Spin Glasses Vohime L Basic Exam,ples. Ergebnisse 
der Mathematik und ihrer Grenzgebiete. 3. Folge A Series of Modern Surveys in Mathematics, 
Volume 54. Springer- Verlag, 2011. 

Michel Talagrand. Mean Field Models for Spin Glasses Volume U: Advanced Replica- Symmetry 
and Low Temperature. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge A Series 
of Modern Surveys in Mathematics, Volume 55. Springer- Verlag, 2011. 

B Yucesoy, Helmut G Katzgraber, J Machta Evidence of Non-Mean-Field-Likc Low- 
Temperature Behavior in the Edwards-Anderson Spin-Glass Model. Physical Review Letters 
109, (17), ppl77204. , Oct (2012) 



22 



